
HANDWRITING DATA INPUT DEVICE WITH MULTIPLE 
CHARACTER SETS 

FIELD OF THE INVENTION 

The present invention relates generally to the field of handwriting 
5 recognition and, more particularly, to handwriting data input devices that 
operate with multiple character sets. 

BACKGROUND OF THE INVENTION 

Handwriting recognition programs generally operate by comparing data 
generated from handwritten words or characters to stored recognition data 

10 (hereinbelow referred to as "reference library 1 ). An attempt is made to 
correctly interpret the handwritten words or characters and to possibly display 
the recognized characters on a display device. 

In order to increase recognition probability and to reduce computation 
time, some character recognition methods employ the splitting of the entire 

15 character set into a plurality of reduced character sets. Each reduced 
character set has a reference library and is associated with a specific input 
area of the digitizer pad. A number of commercially available products make 
use of this technology, associating one reference library with one input area 
and another reference library with another, separate input area. For example, 

20 in the Palm™ connected organizer series, commonly referred to as Palm 
Pilots (commercially available from Palm Inc., Santa Clara, CA USA), 
alphabetic characters are associated with the left part of the digitizer pad and 
numeric characters are associated with the right part. 
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SUMMARY OF THE INVENTION 

There is provided, in accordance with an embodiment of the present 
invention, a handwriting recognition input system. The system includes a 
handwriting input area and a plurality of activatable controls. Each activatable 
control is associated with a different reference library and each is adapted to 
recognize characters input on the handwriting input area as belonging to the 
associated reference library. 

Additionally, in accordance with an embodiment of the present 
invention, the plurality of activatable controls may include software controls, 
hardware controls, or a mix of software and hardware controls. 

Further, in accordance with an embodiment of the present invention, 
the handwriting recognition input system includes at least one activatable menu 
control associated with a multiplicity of the activatable controls. 

Furthermore, in accordance with an embodiment of the present 
invention, the handwriting recognition input system includes at least one 
activatable menu control associated with a multiplicity of other activatable menu 
controls. 

Moreover, in accordance with an embodiment of the present 
invention, a personal digital assistant includes the handwriting recognition input 
system. 

Still further, in accordance with an embodiment of the present 
invention, a mobile telephone includes the handwriting recognition input 
system. 

There is provided, in accordance with an embodiment of the present 
invention, a handwriting recognition system that includes a plurality of 
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activatable contr^reach associated with a reference library and a handwriting 
recognition unit for controlling handwriting recognition in accordance with an 
activated control. 

Furthermore, in accordance with an embodiment of the present 
invention, the handwriting recognition system includes at least one activatable 
menu control associated with a multiplicity of the activatable controls. 

Additionally, in accordance with an embodiment of the present 
invention, the handwriting recognition system includes at least one activatable 
menu control associated with a multiplicity of other activatable menu controls. 

Moreover, in accordance with an embodiment of the present 
invention, a personal digital assistant includes the handwriting recognition 
system. 

Still further, in accordance with an embodiment of the present 
invention, a mobile telephone includes the handwriting recognition system. ' 

There is provided, in accordance with an embodiment of the present 
invention, a personal digital assistant including a housing, a handwriting input 
area mounted on the housing, and a plurality of activatable controls. Each 
activatable control is associated with a different reference library and is adapted 
to recognize characters input on the handwriting input area as belonging to the 
associated reference library. 

There is provided, in accordance with an embodiment of the present 
invention, a personal digital assistant including a housing, a plurality of 
activatable controls each associated with a reference library, and a handwriting 
recognition unit mounted on the housing for controlling handwriting recognition 
in accordance with at least one activated control. 
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> i^Jrovided, in accordance with an emboaime 



There provided, in accordance with an embodiment of the present 
invention, a mobile telephone including a housing, a handwriting input area 
mounted on the housing, and a plurality of activatable controls. Each 
activatable control is associated with a different reference library and is adapted 
s to recognize characters input on the handwriting input area as belonging to the 
associated reference library. 

There is provided, In accordance with an embodiment of the present 
invention, a mobile telephone including a housing, a plurality of activatable 
controls each associated with a reference library, and a handwriting recognition 
10 unit mounted on the housing for controlling handwriting recognition in 
accordance with at least one activated control. 

There is provided, in accordance with an embodiment of the present 
invention, a method for handwriting recognition including the steps of selecting 
at least one character set from among a plurality of character sets and 
15 recognizing at least one character using the at least one selected character set. 

There is provided, In accordance with an embodiment of the present 
invention, a method for handwriting recognition including the steps of 
associating a plurality of controls with a set of reference libraries, activating at 
least one of the controls, and recognizing characters input on a handwriting 
20 input area as belonging to the reference library associated with the at least one 
activated control. 
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IEF DESCRIPTION OF THE DRAWInSSs 

The present invention will be understood and appreciated more fully 
from the following detailed description taken in conjunction with the appended 
drawings in which: 

Fig. 1 is a schematic illustration of a handwriting recognition input unit 
(input unit), constructed and operative in accordance with an embodiment of 
the present invention; 

Fig. 2 is a schematic illustration of input strokes and their possible 
recognition values; 

Fig. 3 is a schematic illustration of an alternative input unit to that of Fig. 

1; 

Fig. 4 is a schematic illustration of a Cyrillic letter; 

Fig. 5 is a schematic illustration of a further alternative input unit; 

Fig. 6 is a schematic illustration of a Kanji character; and 

Fig. 7 is a schematic illustration of a Personal Digital Assistant 
incorporating an input unit such as that of Figs 1, 3, or 5, constructed and 
operative in accordance with an embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE PRESENT INVENTION 

It is not always possible or desirable to use multiple input areas, 
especially for large numbers of reduced character sets or when the 
dimensions of the input area are small (as in cellular telephones for example). 

5 There exists a need for a system having one input area, yet employing a 
plurality of reduced character sets. Applicant has developed a handwriting 
recognition input unit using a single input area with the ability to recognize 
multiple character sets. This is accomplished with controls corresponding to 
specific reduced character sets. When controls are activated, their 

) corresponding character sets are included in the set of characters to be 
recognized. 

Reference is now made to Fig. 1, which is a schematic illustration of a 
handwriting recognition input unit (input unit) 14, constructed and operative in 
accordance with an embodiment of the present invention. Input unit 14 
comprises, in addition to an input area 15 of input unit 14, a plurality of 
controls 26, 28, 30, and 32. 

Input unit 14 may be any type of input unit. Depending on the exact 
type of input unit, the controls may be integrated physically with input area 15 
or may be physically separated. Furthermore, the controls may be software 
or hardware controls. Controls are activated and deactivated through the 
software or hardware user interface, for example by touching or pressing. 

Software controls may be moved or relabeled interactively in addition 
to having their functionality changed. Though hardware controls may change 
function and in some embodiments be relabeled, they cannot be moved. This 
will be discussed further hereinbelow with respect to Figs. 3 and 5. 
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In an embodiment of the present invention, input unit 14 may be for 
example a touch screen or a touchpad, both of which are responsive to 
applied pressure produced by a dedicated stylus or by a user's finger. For 
example, touch screens such as those used on Palm Pilot devices 
(commercially available from Palm inc.). Pocket PC devices (such as the 
iPAQ Pocket PC H3600 device available from Compaq Computer 
Corporation, Houston, Texas, USA), and the Spiral (commercially available 
from Synaptics, Inc. San Jose, CA USA) may be used. An exemplary 
touchpad is the TouchWrfter (also available from Synaptics, Inc.). Each 
control is responsive to a touch (pressure) of a stylus or a finger resulting in 
the activation of the corresponding operation mode. 

In accordance with one embodiment of the present invention, there can 
be four operation modes. "Capital letters" operation mode is associated with 
control 26. In this operation mode, input alphabetical characters are 
recognized as capital letters even if they have been input as lowercase 
letters. If the user presses on lowercase control 28, the system will recognize 
the input characters as lowercase. Analogously, for recognizing numbers, the 
user must push "numeric" control 30. Afterwards, an input vertical line will be 
recognized as number "1" and not as a letter T. "Special" control 32 is 
activated so that the system will recognize special characters (such as $, &, 
@. {, >, ...) and punctuation marks. 

Any recognized character is output or displayed as a character in the 
character set in which it was recognized. Furthermore, in an embodiment of 
the present invention, multiple controls may be active at once, for example 
controls 26 and 32, and hence any of the characters in the corresponding 
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J) # 
d be recognized from an input character Any appropriate 

handwriting recognition method known in the art can be used for character 
recognition. Exemplary methods are disclosed in US patents 6,023,529, 
5,982,929, and 5.659,633 (ail to Han, et al.). If multiple character sets are 
i active at once, handwriting recognition methods that can differentiate 
between ambiguous inputs must be used. 

Reference is now made to Fig. 2, a schematic illustration of input 
strokes and their possible recognition values. Each of the controls 26, 28, 30, 
and 32 is associated with a different reference library. If, for example, 
"numeric" operation mode Is active (via control 30), then input strokes 150, 
152, and 154 shown in Fig. 2 will be recognized and output as numbers "1", 
"9", and "5", respectively. The same strokes would be recognized as letters 
T, "g", and "s", respectively, when lowercase operation mode (via control 28) 
is active. 

Reference is now made to Figs. 3 and 4. Fig. 3 is a schematic 
illustration of another input unit 14', constructed and operative in accordance 
with another embodiment of the present invention. Similar elements have 
similar reference numerals and will not be discussed further here. Fig. 4 is a 
schematic illustration of a Cyrillic letter. 

In this embodiment, input unit 14' includes additional controls 34, 36, 
38, and 40, which correspond to "Japanese", "Chinese", "Cyrillic", and 
"French" operation modes, respectively. Each of controls 34, 36, 38 and 40 is 
associated with a corresponding reference library. If the user wants to input a 
Cyrillic character, he has to activate "Cyrillic" mode via control 38 and then 
input the desired character. The input stroke will then be considered as one 
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of the CyrillicWers. For example, Input stroke 142will be recognized as 
Cyrillic letter 144 (Fig. 4). 

In a further embodiment of the present invention, the selection of a 
particular control causes input unit 14" to display different controls associated 

5 with that choice. This is illustrated in Figs. 5 and 6. to which reference is now 
made. Selection of the "Japanese" operation mode (by selection of control 34 
in Fig. 3) causes controls 34, 36, 38, and 40 to be replaced with new controls. 
Controls 42, 44, and 46 correspond to Katakana, Kanji, and Hiragana character 
sets, respectively. Control 48 returns input unit 14" to Input unit 14', the 

o multi-language mode of Fig. 3. 

The user selects the required operation mode according to the type of 
character he wants to input. For example, for correct recognition of character 
160 (Fig. 6), the user should select control 44 (Fig. 5), which corresponds to the 
Kanji character set To return to the multi-language window of Fig. 3, the user 
may select control 48. 

Note that control 46 is in a different position on input area 15 than 
controls 38 and 40. This is possible because, in this case, software controls 
have been used. 

As the components required to build a computer have been reduced in 
size, new categories of computers have emerged including, for example, 
hand-held computers or Personal Digital Assistants (PDAs) and mobile 
phones. PDAs are well known in the art and are often used to run Personal 
Information Management (PIM) applications, such as an address book, a 
daily organizer, a notebook, and the like. The present invention may be 
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Incorporated A any of these types of devices whe^recognrtion is to be 

performed. 

Reference is now made to Fig. 7, which is a schematic illustration of 
the use of the present invention in a PDA 10, constructed and operative in 
5 accordance with an embodiment of the present invention. This embodiment 
is for illustrative purposes only and shows one possible use of the invention 
among many. PDA 10 includes an output unit 12, input unit 14, and 
exemplary PIM application buttons 16, 18, 20. 22, and 24. Output unit 12 can 
be an LCD display or any other output device. Input unit 14 is the same as in 
o Fig. 1; similar elements have similar reference numerals and will not be 
discussed further here. It will be appreciated by persons skilled in the art that, 
instead of two separate input and output units (12 and 14), a single 
"input-output" unit can be used. 

Exemplary PIM application buttons 16, 18, 20, 22, and 24 correspond 
to Notes, Contacts, To Do, Calendar, and Applications respectively. However, 
in another embodiment of the present invention they could be hardware 
controls as defined hereinabove. Input unit 14 in one embodiment of the 
invention may be a touch screen. However, input unit 14 may be any input 
unit as described generally in any of the embodiments hereinabove or in the 
claims. 

Instead of using a keyboard, many PDAs employ a pen or stylus and a 
digitizer pad as an input system. Most of these PDAs provide some type of 
handwriting recognition system whereby the user can write words and letters 
on the digitizer pad with a pen or stylus. The PDA then converts the user's 
handwriting into a machine-readable format such as ASCII code, which may 



10 



P-3291-US 



lesired. Thus, input unit 14 of the invlntion is used as the 
input unit of the exemplary PDA of Fig. 7. 

Mobile telephones and similar devices also may possess similar 
handwriting input devices to be used instead of numeric buttons for data 
> input Furthermore, there exist other devices which may use handwriting 
input devices similar to input unit 14 for data input. It will be appreciated by 
persons skilled in the art that these devices are included within the scope of 
this invention. . . 

These devices in the prior art often rely on multiple input areas to allow 
increased recognition probability and to reduce computation time. Input unit 
14 may be used instead in such systems, replacing conventional handwriting 
input recognition units. 

It will be appreciated by persons skilled in the art that the present 
invention is not limited by what has been particularly shown and described 
hereinabove. Rather the scope of the invention is defined by the claims that 



follow. 
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